AD-A207  255 


SOME  RESULTS  ON  NONGAUSSIAN  SIGNAL  DEIECTION 


M  M  ww 

C.R.  Baker  .  M.R.  Frey  .  and  A.F.  Gualtierotti 

^^Departnent  of  Statistics  ****IDHEAP 

University  of  North  Carolina  University  of  Lausanne 

Chapel  Hill.  N.C.  27599-3260  CH  1015  Lausanne,  Switzerland 


LISS-31 
March  1989 


This  paper  will  appear  in  Proceedings  12th  Collogue  GRETSI,  Juan-les-Pins , 

France.  June  12-16,  1989. 

Research  supported  by  MW  Contract  N00014-86-K-0039 ,  ONR  Grant  N00014-89-J- 
1175,  and  ARO  Grant  DAAL03-86-G-0022. 

DTIC 

SELECTE 

APR2  8  1989I  I 


DISTRiBimC^J  STATEMENT 

Approved  io;  public  raUose; 

T^wtrlburion  Unlimited  <1  .  ^ 

-  o  a.' 


4 


UNCLASSIFIED 


iSfCUHITV  CUASaiFlCATIQN  Of  THIS  fAGt 


la.  REPORT  security  CLASSIFICATION 

UNCLASSIFIED 


3a.  security  classification  AUTHORITY 


REPORT  DOCUMENTATION  PAGE 


lb.  RESTRICTIVE  MARKINGS 


3b.  OECLASSIFICATION/OOWNGRAOING  SCHEDULE 


A.  PERFORMING  ORGANIZATION  REPORT  NUMBER(S) 


3.  OISTRIBUTION/AVAILABILITY  OF  REPORT 

Approved  for  Public  Release; 

Distribution  Unlimited 


S.  MONITORING  ORGANIZATION  REPORT  NUMBERCSI 


Ba.  name  of  performing  ORGANIZATION 


bk  OFFICE  SYMBOL  7a  NAME  OF  MONITORING  ORGANIZATION 
tlftppUeabUt 


Department  of  Statistics 


6c.  AOORESS  (City.  SImtt  and  ZIP  Codal 

University  of  North  Carolina 
Chapel  Hill,  North  Carolina  27514 


7b.  ADDRESS  (City,  Slaia  and  ZIP  Coda) 


Ba.  NAME  OF  FUNOING/SPONSORING 
ORGANIZATION 


Sb.  OFFICE  SYMBOL  IB.  PROCUREMENT  INSTRUMENT  IDENTIFICATION  NUMBER 
(If  appUeablai  | 


Office  of  Naval  Research 


Be.  ADDRESS  (City.  StaU  and  ZIP  Codal 

Statistics  §  Probability  Program 
Arlington,  VA  22217 


n.  TITLE  dntluda  Saoirity  ClaatiflaationI 


N00pl4-86-K-0039  and  N00014-89-J-1175 


10  TOURCE  OF  FUNDING  NOS. 


PROGRAM 

element  no. 

project 

NO. 

TASK 

NO. 

WORK  UNIT 
NO. 

Detection 

13.  PERSONAL  AUTHORISt 


13a  type  of  report 
TECHNICAL 


IB.  SUPPLEMENTARY  NOTATION 


C.R.  Baker,  M.R.  Frey,  and  A.F.  Gualtierotti 


13b.  time  COVERED 
FROM _  TO 


IS.  PAGE  COUNT 


17. 

COSATI  COOES  1 

FIELD 

GROUP 

SUB.  GR.  1 

IS  SUBJECT  TERMS  (Continua  on  rauarwa  if  naertaary  and  idanUfy  by  bloeb  numbarl 

Signal  detection;  nonGaussian  signal  detection. 


19.  ABSTRACT  iConfinua  on  tavana  ifnataaaary  and  idantify  by  block  numbarl 


Recent  results  on  detection  of  random  nonGaussian  signals  in  additive 
Gaussian  noise  are  discussed.  A  discrete-time  approximation  to  a  likelihood 
ratio  detection  algorithm  is  discussed,  and  preliminary  results  are  presented 
for  a  computational  evaluation  of  the  performance  for  this  approximation.^ 


3a  OISTRIBUTION/AVAILABILITY  OF  ABSTRACT 
UNCLASSIFlEO/UNLIMITEO}^  SAME  AS  RPT.xS(I  OTIC  USERS  □ 


33a  name  of  RESPONSIBLE  INDIVIDUAL 

C.R.  Baker 


DD  FORM  1473.  83  APR  EDITION  OF  1  JAR 


31.  ABSTRACT  SECURITY  CLASSIFICATION 


33b.  TELEPHONE  NUMBER 
(Ineluda  A  raa  Codal 

(919)  962-2189 


EDITION  OF  1  JAN  73  IS  OBSOLETE. 


33c.  OFFICE  SYMBOL 


UNCLASSIFIED _ 

security  classification  of  this  page 


r 


Abstract 

Recent  results  on  detection  of  random  nonGaussian  signals  in  additive 
Gaussian  noise  are  discussed.  A  discrete-time  approximation  to  a  likelihood 
ratio  detection  algorithm  is  discussed,  and  preliminary  results  are  presented 
for  a  computational  evaluation  of  the  performance  for  this  approximation. 


Introduction 


Detection  of  nonGaussian  signals  is  a  problem  that  arises  frequently  in 
undemater  acoustics.  See,  for  example,  the  discussion  in  [1].  The  noise  in 
such  problesis  is  typically  additive  and  frequently  Gaussian.  In  some 
applications,  it  is  nonGaussian.  but  with  properties  similar  in  several 
respects  to  those  of  a  Gaussian  process. 

Detection  of  Gaussian  slgpials  in  Gaussian  noise  is  a  subject  on  which 
there  is  a  voluminous  literature,  and  likelihood  ratios  for  such  problems  are 
by  now  well-understood  |[2}.  However,  detection  of  non-Gaussian  signals  in 
Gaussian  noise  is  a  quite  different  matter.  Until  very  recently,  the  results 
on  nonsingular  detection  and  likelihood  ratios  for  such  problems  were  limited 
to  the  case  where  the  noise  is  a  Wiener  process  [2],  [3]. 

For  detection  of  nonGaussian  signals  in  Gaussian  noise  when  only  moment 
Information  is  used,  one  can  assume  a  convenient  form  for  the  detector,  and 
choose  the  optimum  detector  from  this  class  using  a  signal-to-noise-ratio 


criterion.  The  most  comnonly  used  class  of  detection  algorithms  based  on  I'or 

r 

moment  criteria  is  the  quadratic-plus-linear  detector  with  optimization  done 
according  to  the  deflection  criterion  [4],  [5],  [6].  Thus,  the  test  statistic  n_ 
for  an  observation  x  is  A(x)  =  <x,Wx>  +  <x.h>,  where  <*,•>  denotes  the  inner 


product  in  (as  appropriate)  Lq[0.1]  or  n-dimenslonal  Euclidean  space  E*'.  The 
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operator  W  and  vector  h  are  selected  to  nEccimize  D(W.h)  = 

CEs+nA(x)  -  EjjA(x)f 

- s - S-.  E,g{*)  denotes  expectation  w.r.t.  the  noise.  £<,  „{•) 

EjjA^Cx)  -  (Ej^{x))2  ^ 

w.r.t.  sigpial-plus-noise.  The  optimum  (W.h)  is  then  given  by  [5],  [6]: 

W  =  h  =  where  and  denote  the  covariance  operators 

of  the  signal-plus-noise  and  noise  processes,  respectively,  and  m  is  the  mean 
of  the  signal  process. 

Since  the  information  required  to  iaplement  the  deflection  criterion 
quadratic-linear  detector  is  relatively  easy  to  obtain,  and  the  algorithm  is 
well-known  and  widely-used,  it  is  an  appropriate  benchmark  for  evaluation  of 
the  performance  of  any  algorithm  for  detection  of  nonGaussian  signals  in 
Gaussian  noise. 

Of  course,  the  desired  detection  algorithm  for  any  detection  problem 
(using  various  criteria)  is  well-known  to  be  a  monotone  function  of  the 
likelihood  ratio.  The  difficulty  is  that  such  algorithms  require  more 
Information  than  is  usually  available.  In  particular,  in  sonar  applications 
one  will  typically  not  know  the  family  of  finite-dimensional  distributions  for 
the  signal-plus-noise  process. 

However,  there  are  some  models  of  this  detection  problem  for  which  the 
implementation  of  the  likelihood  ratio  does  not  require  advance  knowledge  of 
the  statistics  of  the  signal-plus-noise  process.  Such  a  detector  is  described 
in  [7],  based  on  theoretical  results  obtained  in  [8].  It  assumes  that  the 
slgnal-plus-nolse  is  a  filtered  diffusion  process.  This  algorithm  will  be 
briefly  discussed  in  this  peq>er.  and  some  preliminary  computational  results  on 
performance  will  be  presented,  including  comparison  with  performance  of  the 
optimum  quadratic- linear  detector  based  on  the  deflection  criterion. 

The  theoretical  results  are  based  on  the  spectral  representation  of 
purely  nonde termini s tic  second-order  processes,  as  developed  by  Cramer  [9]  and 
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Hlda  [10]-  In  particular.  If  (N^)  is  any  m.a.  continuous  purely 
nondeterainistic  stochastic  process  on  [0.1],  then  (N^)  has  the  proper 
canonical  representation  [10] 

=  2  X^F  (t.s)dB  (s) 

t  i^l  u  1  z 

where  the  nultiplicity  H  can  be  infinite,  {Bj,  i  ^  M}  is  a  family  of  mutually 
orthogonal  orthogonal-incresient  processes  with  (non-decreasing)  variances 
1  ^  K},  and  the  non-random  functions  {F^.  i  ^  N)  satisfy 

In  the  case  where  (N^)  is  Gaussian,  the  processes  i  ^  M}  are 

mutual ly-independent  independent-increment  Gaussian  processes,  which  can  be 
assumed  path-continuous. 

The  equality  in  the  above  expression  for  (N  )  is  an  equality  in  the  mean- 

V 

square  sense  for  each  t.  However,  by  assuming  separability,  one  obtains  path 
eqiiality  in  the  almost  sure  sense. 

Nonsingular  Detection  and  Likelihood  Ratios 

A  basic  question  to  be  considered  for  any  detection  problem  is  that  of 
model  validity.  Since  physical  detection  problems  are  typically  nonsingular 
(non-zero  probability  of  error),  nonsingularity  is  an  important  consideration, 
especially  in  the  case  of  continuous-time  processes.  In  fact,  since  one  is 
typically  seeking  to  determine  a  likelihood  ratio,  the  model  should  first  by 
analyzed  to  determine  whether  or  not  a  likelihood  ratio  exists;  this  is  one 
aspect  of  nonsing^lar  detection.  The  version  of  nonsingular  detection 
required  in  order  for  the  likelihood  ratio  to  exist  is  of  the  following  form: 
for  any  detection  algorithm  giving  zero  probability  of  false  alarm,  one  must 
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also  have  zero  probability  of  detection.  This  is  absolute  continuity  of  the 
sig^l-plus-noise  probability  measure  with  respect  to  the  noise  measure 

^  These  probed>ilities  are  induced  on  the  space  of  sample 

functions  by  the  stochastic  processes  and  (N^);  they  can  be  taken  on 

either  the  space  of  all  real-valued  functions  on  [0.1],  or  on  L2[0.1]. 

Sufficient  conditions  and  necessary  conditions  have  been  obtained  for  each 
case  [8],  along  with  expressions  for  the  likelihood  ratio.  These  conditions 
all  involve  a  sigpial-plus-noise  representation  of  the  form 

**  t_ 

where  X^(t)  =  jQQ^(s)d/3^(s)  +  B^(t),  and  the  vector  stochastic  process  (Q(t)) 
satisfies  certain  measurability  conditions  and.  moreover,  Z^_^/QQ^(s)dJ3^(s) 

<  •  with  probcd>illty  one.  The  last  condition  is  equivalent  to  the  signal 
process  having  almost  all  paths  in  the  reproducing  kernel  Hilbert  space  of  the 
noise. 


A  Discrete-Time  Detection  Algorithm 

The  development  to  be  described  here  is  given  in  more  detail  in  [7]. 
First,  it  is  assumed  that  the  original  continuous- time  noise  process  has 
multiplicity  one  and  that  (X^)  is  a  diffusion  with  respect  to  a  Wiener  process 
(W,): 

X(t)  =  Xoa[X^]ds  +  W(t). 

See  [7]  for  a  discussion  of  these  assumptions.  Of  course,  this  does  not 
reduce  the  class  of  noise  processes,  since  any  discrete-parameter  zero-mean 
Gaussian  noise  process  can  be  obtained  as  a  causal  linear  operation  on  white 
Gausslaun  noise.  Thus,  one  can  write  the  noise  vector  N  as  N  a  F  BS.,  where  SV 
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consists  of  nomalized  Increments  of  the  Wiener  process.  The  discretized  form 
of  the  signal-plus-noise  process  under  these  same  assumptions  is  then 
S  -»■  N  =  F  S)^,  where  for  a  sampling  Interval  A. 


X(1A)  =  A  2  a[X(JA)]  +  W(iA). 

=  X(iA)  -  X([1-1]A).  X(0)  a  0. 


Moreover,  =  FF  .  where  F  is  a  lower- triangular  matrix.  Let  L  be  the 
summation  matrix.  (LX)j  =  2j_jXj  (Ljj  =  1  for  1  $  J:  L^j  =  0  for  i  >  J).  The 
discrete-time  detection  algorithm  then  can  be  expressed  as  follows.  For  an 
observation  vector  in  r".  an  approximation  to  the  log- likelihood  ratio  is 
given  by  the  test  statistic 

t”(x)  =  V(aC(L  E'^X) J)C(L  -  (L  -  (A/2)Va\(L  E"^x),] 

JaO  *  J  J=0 

J=0  J  J  *  J=0  J 

If  now  a  new  data  point  x  .  is  observed,  the  approximation  has  the  recursive 


=  t"{x)  +  oCa  E'^x)^])[(F'^x)^j  -  (A/2)  a^[(L  E'^x)^]. 


Implementation  and  calculation  of  r  require  the  following  operations. 
First,  the  function  a  must  be  known  and  programsied.  Given  the  value  of 
and  the  observation  =  (Xj,...,x^).  one  stores  t"(x”),  x”.  a[(L  F  ^x)^].  and 
(It  E  When  the  data  point  x^^j  is  received,  it  is  only  necessary  to  use 

x***^  to  calculate  (F  which  means  to  cross-correlate  the  observation 

with  the  n+1  row  of  E  This  nui^jer,  say  Is  then  used  to  form 

Tn+l(^n+lj  ^n+lj^n+lj  ^  ^n^^nj  ^  aC2^j]b^^j  -  (A/2)a2[2jbj].  Other 
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approximations  can  be  given,  including  one  [1]  based  on  the  eigenvalues  and 
eigenvectors  (for  an  observation  in  e”)  of  the  nxn  matrix  with  elements 
{Rj^(i.J):  i.J  ^  n}.  The  form  given  here  has  the  advantage  of  computational 
efficiency,  including  recursive  properties. 

Of  course  even  under  the  above  assuaptions.  one  cannot  assert  that  the 
discretized  version  of  the  continuous- time  likelihood  ratio  is  the  actual 
discrete-time  likelihood  ratio.  For  the  Gaussian  case  (a  linear),  optimality 
can  be  shown  [7].  but  for  a  general  a  one  can  only  assert  asymptotic 
optimality.  The  designation  of  this  algorithm  as  a  "likelihood  ratio"  should 
be  understood  to  mean  that  it  is  an  apprmcimation  to  the  log-likelihood  ratio. 

In  many  explications,  one  will  know  (thus  the  matrix  F).  while  a  will 

be  unknown.  One  procedure  for  implementing  this  detector  is  then  as  follows. 
Given  an  observed  discrete-time  sample  function,  y.  obtain  (eui  eissumed)  ^  by 
^  =  F  ^y.  Using  X(0)  s  0.  form  )C  and  use  this  sample  vector  to  estimate  a. 
SSubstitute  a  into  the  likelihood  ratio  and  then  evaluate  the  likelihood  ratio 
using  the  original  observation  y.  Compare  the  likelihood  ratio  with  a 
threshhold.  the  threshold  being  determined  by  the  desired  value  of  the 
probability  of  false  alarm,  using  the  estimated  value  of  a  and  the  known  R^. 

Computational  development  of  such  an  algorithm,  based  on  single-sample- 
path  information,  is  now  underway.  Some  preliminary  results  are  given  in  the 
next  section.  Since  determination  of  the  matrix  F  is  not  expected  to  be  a 
major  problem,  the  results  were  obtained  for  F  s  I.  An  algorithm  for 
estimating  a  was  developed,  based  upon  assuming  that  the  drift  function  a  can 
be  approximated  by  a  low-order  polyntmaial.  The  simulation  is  described  in  the 


next  section. 


A  series  of  simulations  were  conducted.  In  each  case  an  ensemble  of 
sampled  noise  paths  and  an  ensemble  of  saiopled  signal-plus-noise  paths  were 
generated  and  processed  by  the  likelihood  ratio  detector.  The  same  noise  and 
signal-plus-noise  ensembles  were  also  passed  through  the  deflection  criterion 
detector  to  provide  a  relative  measure  of  performance.  It  should  be  noted 
that  in  obtaining  these  preliminary  results,  the  diffusion  drift  function  was 
estimated  from  an  observed  diffusion  path.  In  practice  the  diffusion  drift 
will  be  estimated  from  t^e  observation  vector,  which  may  be  only  noise. 

The  Wiener  noise  paths  and  diffusion  signal  paths  considered  here  are 
indexed  by  an  interval  of  length  T  and  sampled  at  a  rate  R.  Each  path  is  then 
represented  by  RT  samples.  The  size  of  the  signal  path  ensemble  and  the  size 
of  the  noise  path  ensemble  are  each  N.  Thus,  the  diffusion  signal-plus-noise 

sampled  path  ensemble  {X  n  s  1 . RT}  and  the  Wiener  noise  sampled  path 

ensemble  {W  n  =  l....,N.  t  a  1,...,RT)  are  each  represented  by  NRT  sample 

n  t  V 

points.  W  /V  a  0  and  X  n  =  0  for  each  n.  For  each  simulation,  noise  path 
n.u  n.u 

samples  were  generated  recur-slvely  using  ^  +  (p/v^)N(0, 1) ,  where 

N(0,1)  represents  Independent  realizations  of  a  standard  normal  random 
variable  and  p  is  the  variance  parameter  of  the  Wiener  process.  Samples 
representing  the  diffusion  path  ensemble  were  generated  using  X  a 
X^  +  (l/R)a(X^  ^_j)  +  (p/'^)N(0. 1).  where  a  is  the  drift  of  the  diffusion. 
The  realizations  of  the  standard  normal  random  variable  used  in  the  formation 
of  the  diffusion  samples  were  generated  independently  of  the  set  of  samples  in 
the  noise  path  ensemble. 

To  calculate  the  deflection  detector  output,  the  known  inverse  covariance 
matrix  for  the  Wiener  process  was  used.  For  the  diffusion  signal-plus-noise 
process,  the  covariance  matrix  was  estimated  from  the  ensemble  of  sampled 
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paths: 


N 


1  *'  T  _ T 

“x  =  k  ^  W  - 

nsl 


th 


where  X  is  the  column  vector  of  samples  of  the  n  path  in  the  signal-plus- 

"Tl 

noise  ensendble  and  X  is  the  sample  mean  X  s  ^  ^sl^' 

Polynomial  regression  provides  one  approach  to  the  estimation  of  the 
drift  function  of  the  diffusion.  The  diffusion  (X^).  t  €  [0,T]  is  given  by 
the  equation: 

X^(«)  =  Xjo(X^(«))d8  +  W^(«) 


where  (W^)  is  a  Wiener  process  and  a  is  the  unknown  drift  function.  An 
increment  of  the  diffusion  can  be  expressed  as  = 

Xi*^a(X  )ds  +  (W,^.-W,).  Define  6X.  =  X,^.-X,.  and  choose  A 

small  enough  that  )d8  s  o(X  )A.  Suppose  also  that  A  divides  T;  then 

5Xj  =  a(X^)A  +  5f^.  Suisse  a  is  a  polynomial,  a(x)  =  <7q  +  +  . . .  + 

and  let  2  be  the  pi-l-dlmenslonal  vector  of  coefficients  of  o{x).  Then  one  can 
write  I  =  Xg  +  N  where 


\-r«kA’ 

where  1  ^  k  1  T/A  -  1  and  1  <  i  £  p+1.  N  is  a  vector  of  i.i.d.  Gaussian 
r.v.’s  with  zero  mean  and  standard  deviation  of  p/-^.  The  coefficients  of  a 
can  be  estimated  by  solving  the  regression  Y  =  Xg  N. 

The  order  p  of  the  polynomial  a  is  unknown.  It  is  estimated  concurrently 
with  a  by  solving  the  regression  problem  X  =  Xg  N  first  for  p  =  0  and  then 
for  successively  higher  values  of  p  until  increases  in  the  coefficient  of 
determination 

o  n  ^  *  o  ^  o 

r  =  2  (Y  -  Y)V  2  (Y.  -  Y)^ 
ksl  **  k=l  “ 


are  no  longer  significant.  This  same  procedure  can  also  be  applied  in  cases 
in  which  the  drift  function  is  not  a  polynomial,  although  in  many  such  cases 
it  may  fail  to  give  reasonable  estimates  and  could  be  improved  upon  in  a 
variety  of  ways.  However,  this  estimation  procedure  does  serve  to  demonstrate 
the  potential  of  the  likelihood  ratio  detector  and  is  the  procedure  used  in 
obtaining  the  simulation  results  shown  in  Figures  1.  2.  and  3.  The  results 
shown  in  these  figures  were  obtained  using  N  =  5000.  R  =  100.  and  T  =  1.  The 
variance  parameter  p  of  (V^)  Is  unity.  The  false  alarm  probabilities  are  90% 
conf idence-bounded . 


Figure  1 .  Detector  Performance,  Linear  Drift.  Figure  2.  Detector  Performance,  Cubic  Drift. 


Figure  3.  Detector  Performance,  Arctangent  Drift. 
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